Imaging device camera system and driving method of the same

ABSTRACT

An imaging device including an electronic shutter and a pixel array with color pixels with different characteristics of spectral sensitivity arranged. The pixel array part has at least one clear pixel, the plurality of color pixels including at least two of (i) a first color filter pixel having a peak of spectral sensitivity characteristics for red, (ii) a second color filter pixel having a peak for blue, and (iii) a third color filter pixel having a peak for green. The clear pixel has a high transmittance arranged in an oblique pixel array system at a given position of a given row and a given column with respect to the first color filter pixel, the second color filter pixel, and the third color filter pixel. An electronic shutter is separately driven for the at least one clear pixel and for the plurality of color filter pixels.

RELATED APPLICATION DATA

This application is a continuation of U.S. patent application Ser. No.13/523,374, filed on Jun. 14, 2012, which is a continuation of U.S.patent application Ser. No. 12/703,704, filed on Feb. 10, 2010, nowissued as U.S. Pat. No. 8,227,737 which is a division of U.S. patentapplication Ser. No. 11/688,564, filed Mar. 20, 2007, now issued as U.S.Pat. No. 7,671,316, the entireties of which are incorporated herein byreference to the extent permitted by law. The present invention claimspriority to and contains subject matter related to Japanese PatentApplication JP 2006-100931 filed in the Japanese Patent Office on Mar.31, 2006, the entire contents of which being incorporated herein byreference to the extent permitted by law.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an imaging device, a camera system anda driving method of the same, provided with a solid state imaging devicesuch as a CCD (Charge Coupled Device), and a CMOS (Complementary MetalOxide Semiconductor) sensor, particularly to an imaging device and acamera system in which in a two dimensional pixel array using aplurality of color filters, the pixel arrangement and the pixel arrayare sequentially scanned for exposure and read operation.

2. Description of the Related Art

For a color filter arrangement of an imaging device, the Bayer array isknown which uses two green (G) filters, a single red (R) filter, and asingle blue (B) filter of three primary colors with excellent colorreproducibility. The Bayer array is an arrangement that places moreimportance on the resolution of brightness than color.

An imaging device is proposed in which a pixel arrangement is providedwith transparent filters arranged in order to increase sensitivity whileexcellent color reproducibility is retained in the color filterarrangement (for example, see JP-A-8-23542 (Patent Reference 1)).

In addition, an imaging device is proposed in which the transparentfilter arrangement is improved to secure the signal charge amount andthe color resolution even though pixels are miniaturized (for example,see JP-A-2004-304706 (Patent Reference 2)).

SUMMARY OF THE INVENTION

However, in the imaging device described above, the apparatus haslimitations on the improvement of resolution and color reproducibility.

In addition, it is difficult to control color information at dark placesand bright places using color filter pixels and transparent filterpixels freely, and it is difficult to create almost natural colordepending on luminosity.

Thus, it is desirable to provide an imaging device and a camera systemwith excellent color reproducibility which can improve resolution.

It is also desirable to provide an imaging device and a camera systemwhich can create almost natural color depending on luminosity.

An imaging device according to an embodiment of the invention is animaging device including: a pixel array part in which a plurality ofpixels with different characteristics of spectral sensitivity arearranged in an array and which converts light transmitted through thepixel is converted into an electric signal, wherein in the pixel arraypart, among a first color filter pixel having a peak of spectralsensitivity characteristics in red, a second color filter pixel having apeak in blue, and a third color filter pixel having a peak in green,each including a color filter, at least a plurality of the first colorfilter pixels and the second color filter pixels is arranged in anoblique pixel array system, and a clear pixel having a hightransmittance is arranged in an oblique pixel array system at a givenposition of a given row and a given column in the oblique pixel arraywith respect to the first color filter pixel, the second color filterpixel, and the third color filter pixel.

The oblique pixel array means that the pixels of the columns of eachseries are offset by a predetermined amount from the pixels of thecolumns of the other series.

Preferably, in the pixel array part, a first color filter pixel having apeak of spectral sensitivity characteristics in red, a second colorfilter pixel having a peak in blue, and a third color filter pixelhaving a peak in green, each including a color filter are arranged in anarray, and the clear pixel is uniformly arranged between the colorfilter pixels.

Preferably, the pixel array part includes a pixel row and a pixel columnformed only of the clear pixel.

In addition, another pixel array part includes a pixel row and a pixelcolumn formed only of the clear pixel.

Preferably, the pixel array part includes a pixel row and/or a pixelcolumn having the clear pixel and at least one color filter pixel mixed.

Preferably, a read channel exclusive for the clear pixel and a readchannel exclusive for the color filter pixel are provided separately.

Preferably, a function is provided that separately performs electronicshutter drive for the clear pixel and for the color filter pixel.

An imaging device according to an embodiment of the invention is animaging device including: a pixel array part in which a plurality ofpixels with different characteristics of spectral sensitivity arearranged in an array and which converts light transmitted through thepixel into an electric signal, wherein in the pixel array part, among afirst color filter pixel having a peak of spectral sensitivitycharacteristics in red, a second color filter pixel having a peak inblue, and a third color filter pixel having a peak in green, eachincluding a color filter, at least a plurality of the first color filterpixels and the second color filter pixels is arranged in an array, aclear pixel having a high transmittance is arranged at a given positionof a given row and a given column in the array pixel arrangement withrespect to the first color filter pixel, the second color filter pixel,and the third color filter pixel, and a read channel exclusive for theclear pixel and a read channel exclusive for the color filter pixel areseparately provided.

An imaging device according to an embodiment of the invention is animaging device including: a pixel array part in which a plurality ofpixels with different characteristics of spectral sensitivity arearranged in an array and which converts light transmitted through thepixel into an electric signal, wherein in the pixel array part, among afirst color filter pixel having a peak of spectral sensitivitycharacteristics in red, a second color filter pixel having a peak inblue, and a third color filter pixel having a peak in green, eachincluding a color filter, at least a plurality of the first color filterpixels and the second color filter pixels is arranged in an array, aclear pixel having a high transmittance is arranged at a given positionof a given row and a given column in the array pixel arrangement withrespect to the first color filter pixel, the second color filter pixel,and the third color filter pixel, and a function is provided thatseparately performs electronic shutter drive for the clear pixel and forthe color filter pixel.

A camera system according to an embodiment of the invention is a camerasystem including: an imaging device; an optical system operable to leadincident light to an imaging part of the imaging device; and a signalprocessing circuit operable to process an output signal of the imagingdevice, wherein the imaging device includes: a pixel array part in whicha plurality of pixels with different characteristics of spectralsensitivity are arranged in an array and which converts lighttransmitted through the pixel into an electric signal, wherein in thepixel array part, among a first color filter pixel having a peak ofspectral sensitivity characteristics in red, a second color filter pixelhaving a peak in blue, and a third color filter pixel having a peak ingreen, each including a color filter, at least a plurality of the firstcolor filter pixels and the second color filter pixels is arranged in anoblique pixel array system, a clear pixel having a high transmittance isarranged in an oblique pixel array system at a given position of a givenrow and a given column in the oblique pixel array with respect to thefirst color filter pixel, the second color filter pixel, and the thirdcolor filter pixel, a read channel exclusive for the clear pixel and aread channel exclusive for the color filter pixel are separatelyprovided, and a function is provided that separately performs electronicshutter drive for the clear pixel and for the color filter pixel.

A camera system according to an embodiment of the invention is a camerasystem including: an imaging device; an optical system operable to leadincident light to an imaging part of the imaging device; and a signalprocessing circuit operable to process an output signal of the imagingdevice, wherein the imaging device includes: a pixel array part in whicha plurality of pixels with different characteristics of spectralsensitivity are arranged in an array and which the light transmittedthrough the pixel is converted into an electric signal, wherein in thepixel array part, among a first color filter pixel having a peak ofspectral sensitivity characteristics in red, a second color filter pixelhaving a peak in blue, and a third color filter pixel having a peak ingreen, each including a color filter, at least a plurality of the firstcolor filter pixels and the second color filter pixels is arranged in anarray, a clear pixel having a high transmittance is arranged at a givenposition of a given row and a given column in the array pixelarrangement with respect to the first color filter pixel, the secondcolor filter pixel, and the third color filter pixel, a read channelexclusive for the clear pixel and a read channel exclusive for the colorfilter pixel are separately provided, and a function is provided thatseparately performs electronic shutter drive for the clear pixel and forthe color filter pixel.

According to an embodiment of the invention, an imaging device can beimplemented which intends an improved resolution with excellent colorreproducibility.

In addition, according to an embodiment of the invention, almost naturalcolor can be created depending on luminosity.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a block diagram depicting an exemplary configuration of theessential part of an imaging device according to an embodiment of theinvention;

FIG. 2 shows a circuit diagram depicting an exemplary unit pixelaccording to the embodiment;

FIG. 3 shows a diagram schematically depicting an exemplary pixelarrangement of a pixel array part 11 according to the embodiment;

FIG. 4 shows a diagram conceptually depicting the spectralcharacteristics of color filter pixels R, G, and B and a clear pixel C;

FIG. 5 shows a diagram illustrative of an oblique pixel array;

FIG. 6 shows a diagram illustrative of advantages to adopt the obliquepixel array;

FIG. 7 shows a diagram depicting a basic oblique pixel array unit inwhich a clear pixel C is inserted in the middle of four color filterpixels R, G, G, and B in the Bayer array;

FIG. 8 shows a diagram illustrative of the read mode for the pixel arraypart when driven in the embodiment;

FIG. 9 shows a diagram schematically depicting the drive mode for anelectronic shutter in the embodiment;

FIG. 10 shows a diagram illustrative of a read scheme of the clear pixelC in a read channel CH-A, in which nine pixels are added and read;

FIG. 11 shows a diagram illustrative of the read scheme of the colorfilter pixels (color pixels) R, G, and B in the read channel CH-B, inwhich nine pixels are added and read;

FIG. 12 shows a diagram illustrative of the read scheme of the clearpixel C in the read channel CH-A, in which five pixels are added andread;

FIG. 13 shows a diagram illustrative of the read scheme of the colorfilter pixels (color pixels) R, G, and B in the read channel CH-B, inwhich five pixels are added and read;

FIG. 14 shows a block diagram depicting an exemplary configuration of asignal processing part in the subsequent stage according to theembodiment;

FIG. 15 shows a diagram illustrative of a white balance control processat bright places in the embodiment;

FIG. 16 shows a diagram illustrative of the white balance controlprocess at dark places in the embodiment;

FIG. 17 shows a diagram simply depicting a partial cross section of thepixel array part according to the embodiment;

FIG. 18 shows a diagram simply depicting a partial cross section ofanother exemplary configuration of the pixel array part according to theembodiment;

FIG. 19 shows a diagram depicting a second exemplary pixel arrangementof the pixel array part according to the embodiment;

FIG. 20 shows a diagram depicting an exemplary configuration of in whichthe clear pixels and color filter pixels are mixed in the same row inthe oblique pixel array;

FIG. 21 shows a diagram depicting a third exemplary pixel arrangement ofthe pixel array part according to the embodiment;

FIG. 22 shows a diagram depicting a fourth exemplary pixel arrangementof the pixel array part according to the embodiment;

FIG. 23 shows a diagram depicting a fifth exemplary pixel arrangement ofthe pixel array part according to the embodiment;

FIG. 24 shows a diagram depicting a sixth exemplary pixel arrangement ofthe pixel array part according to the embodiment;

FIG. 25 shows a diagram depicting a seventh exemplary pixel arrangementof the pixel array part according to the embodiment;

FIG. 26 shows a diagram depicting an eight exemplary pixel arrangementof the pixel array part according to the embodiment;

FIG. 27 shows a diagram depicting a ninth exemplary pixel arrangement ofthe pixel array part according to the embodiment;

FIG. 28 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 4 is rotated into the rectangular array;

FIG. 29 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 19 is rotated into the rectangular array;

FIG. 30 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 21 is rotated into the rectangular array;

FIG. 31 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 22 is rotated into the rectangular array;

FIG. 32 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 23 is rotated into the rectangular array;

FIG. 33 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 24 is rotated into the rectangular array;

FIG. 34 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 25 is rotated into the rectangular array;

FIG. 35 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 26 is rotated into the rectangular array;

FIG. 36 shows a diagram depicting an example in which the oblique pixelarray shown in FIG. 27 is rotated into the rectangular array;

FIG. 37 shows a diagram depicting an exemplary configuration in whichthe clear pixels and color filter pixels are mixed in the same row inthe rectangular array;

FIG. 38 shows a diagram depicting an exemplary configuration in which ashutter wiring is provided to each of color filter pixels and clearpixels in the rectangular array; and

FIG. 39 shows a block diagram depicting the outline of the configurationof a camera system according to an embodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

Hereinafter, an embodiment of the invention will be described withreference to the drawings.

FIG. 1 shows a block diagram depicting an exemplary configuration of theessential part of an imaging device according to an embodiment of theinvention.

As shown in FIG. 1, an imaging device 10 has a pixel array part (ARY)11, a clear pixel horizontal scanning circuit (CHSCAN) 12, a color pixelhorizontal scanning circuit (CLRHSCAN) 13, a vertical scanning circuits(VSCAN) 14-1 and 14-2, a timing control part 15, a power source part 16,a clear pixel analog front end part (CAFE) 17, and a color pixel analogfront end part (CLRAFE) 18.

For example, in the pixel array part 11, sensor unit pixels are arrangedin an array in a predetermined arrangement form.

In addition, the pixel array part 11 is wired with a transfer selectionline, a reset line, and a select line in each row in the pixelarrangement, and a signal line in each column in the pixel arrangement.

FIG. 2 shows a circuit diagram depicting an exemplary unit pixelaccording to the embodiment. In FIG. 2, a CMOS sensor is shown as anexample.

A unit pixel 110 shown in FIG. 2 has a photodiode 111, a transfertransistor 112, an amplifier transistor 113, a select transistor 114, areset transistor 115, and a floating node ND 111.

The photodiode 111 photoelectrically converts incident light into signalcharge in the amount of electric charge in accordance with the lightquantity (for example, electrons).

The transfer transistor 112 is connected between the cathode of thephotodiode 111 and the floating node ND 111, and the gate is connectedto a transfer selection line TRFL, which has a function that it isconducted (turned on) to transfer the signal charge stored in thephotodiode 111 to the floating node ND 111.

The amplifier transistor 113 and the select transistor 114 are seriallyconnected between a power source potential VDD and a signal line SGNL.

The gate of the amplifier transistor 113 is connected to the floatingnode ND 111, which amplifies the potential of the floating node ND 111,and outputs it to the signal line SGNL through the select transistor114.

The gate of the select transistor 114 is connected to a select lineSELL.

In the reset transistor 115, the source is connected to the floatingnode ND 111, the drain is connected to a predetermined potential line,and the gate is connected to a reset line RSTL, which has a functionthat resets the potential of the floating node ND 111.

The transfer selection line TRFL, the select line SELL, and the resetline RSTL which are wired to each row in the pixel arrangement areselectively driven by the vertical scanning circuit 14. The signal lineSGNL selectively transfers signals read out of pixels to the clear pixelhorizontal scanning circuit 12, and the color pixel horizontal scanningcircuit 13.

The drive timing of the horizontal scanning circuits 12 and 13 and thevertical scanning circuit 14 is controlled by the timing control part15.

FIG. 3 shows a diagram schematically depicting an exemplary pixelarrangement of the pixel array part 11 according to the embodiment.

As shown in FIG. 3, the pixel array part 11 shown in FIG. 3 adopts anoblique pixel array, and is formed in a pixel arrangement in which theclear pixel C that has a high transmittance is inserted between a colorfilter pixel R having the peak of the spectral sensitivitycharacteristics in red, the color filter pixel G having the peak ingreen, and the color filter pixel B having the peak in blue, eachincluding a color filter in the vertical and oblique directionsuniformly, whereby the deviation of the resolution is removed.

In addition, the clear pixel C is not necessarily white.

In the pixel arrangement shown in FIG. 3, even numbered rows and evennumbered columns including the zeroth row and the zeroth column are allconfigured of color filter pixels, and add numbered rows and addnumbered columns are all configured of clear pixels C.

FIG. 4 shows a diagram conceptually depicting the spectralcharacteristics of the color filter pixels R, G, and B and the clearpixel C.

In FIG. 4, the horizontal axis depicts the wavelength, and the verticalaxis depicts the relative output.

As apparent from FIG. 4, the clear pixel C has sensitivity nearlythroughout the visible light area (wavelengths of 360 nm to 700 nm). Inother words, since the clear pixel C has a wide wavelength areacomponent (including all the color signals), it is easy to provide colorreproduction at the border of the clear pixel.

Hereinafter, the characteristic configuration of the pixel array part 11will be described more in detail with reference to FIGS. 5 to 13.

As shown in FIG. 5, in the pixel array part 11 according to theembodiment, a so-called rectangular unit pixel RGPXL is arranged in aso-called oblique pixel OBLPXL in which the unit pixel is rotated at apredetermined angle θ (θ=0° to 90°) about a column axis CAX.

An advantage that adopts the oblique pixel OBLPXL array will bedescribed with reference to FIG. 6. In addition, in FIG. 6, the Bayerarray is taken as an example.

The pixel pitch of the oblique pixel OBLPXL is 1/√2 when the turningangle θ is 45 degrees where the pixel pitch PTC of the rectangular pixelRGPXL is 1. Thus, the pixel pitch can be made smaller without changingthe size of the pixel.

In the embodiment, as shown in FIG. 7, the clear pixel C is inserted inthe middle of four color filter pixels R, G, G, and B in the Bayer arrayin the oblique pixel array to form the basic oblique pixel array unit.

The Bayer array is left to easily perform a color interpolation processfor a signal processing system.

For the read mode of the pixel array part 11 having the configurationwhen it is driven, the clear pixel C and the color filter pixels (colorpixels) R, G, and B are read by different channels.

In the embodiment, for example, as shown in FIG. 8, a read channel CH-Aexclusive for clear pixels and a read channel CH-B exclusive for colorfilter pixels are provided separately to read the clear pixel C and thecolor filter pixels R, G, and B independently.

In the example shown in FIG. 8, the clear pixel horizontal scanningcircuit 12 is arranged as a read processing system for the channel CH-Aon the upper side in the drawing, and the color filter pixel (colorpixel) horizontal scanning circuit 13 is arranged as a read system forthe channel CH-B in the lower side in the drawing.

In the embodiment, a signal line SGNL-O wired to the add numbered columnis connected to the clear pixel horizontal scanning circuit 12, and asignal line SGNL-E wired to the even numbered column is connected to thecolor filter pixel (color pixel) horizontal scanning circuit 13.

In the embodiment, in addition to adopting the mode in which the clearpixel C and the color filter pixels (color pixels) R, G, and B are readby different channels, it is configured in which the time period, rate,and gain in processing in the subsequent stage of the electronic shutter(rolling shutter) are separately changed between the clear pixel C andthe color filter pixels (color pixels) R, G, and B.

FIG. 9 shows a diagram schematically depicting the drive mode of theelectronic shutter in the embodiment.

In the embodiment, as shown in FIG. 9, the pixels can be read by varyingthe time for the rolling shutter between the storage time for the clearpixel and the color pixel.

In addition, the shutter speed may be varied separately between theclear pixel and the color filter pixels (color pixels) R, G, and B.

For example, at a bright place, the shutter for the clear pixel isreleased quickly to prevent the saturation of the clear pixel, whereasat a dark place, in reverse, the shutter for the clear pixel is releasedslowly to increase sensitivity.

With this configuration, color information is increased at a brightplace, and color information is decreased at a dark place, wherebynatural color can be created.

In the embodiment, in order to implement high speed read, a so-calledadding read scheme is adopted.

FIG. 10 shows a diagram illustrative of the read scheme of the clearpixel C in the read channel CH-A, in which nine pixels are added andread.

FIG. 11 shows a diagram illustrative of the read scheme of the colorfilter pixels (color pixels) R, G, and B in the read channel CH-B, inwhich nine pixels are added and read.

As shown in FIGS. 10 and 11, nine pixels are added, whereby theinterpolation process can be easily performed without losing thearrangement in which the clear pixel C is arranged in the middle of theBayer array.

FIG. 12 shows a diagram illustrative of the read scheme of the clearpixel C in the read channel CH-A, in which five pixels are added andread.

FIG. 13 shows a diagram illustrative of the read scheme of the colorfilter pixels (color pixels) R, G, and B in the read channel CH-B, inwhich five pixels are added and read.

As shown in FIGS. 12 and 13, also in the case of adding five pixels, thepixels at closer positions are added in the case of adding nine pixels,whereby color reproducibility is improved without losing the arrangementin which the clear pixel C is arranged in the middle of the Bayer array.

From the view point of the read rate, adding nine pixels isadvantageous.

As described above, the read signal of the clear pixel C read inaccordance with the adding read scheme is forwarded to the clear pixelAFE 17 through the horizontal scanning circuit 12.

In addition, the read signal of the color filter pixels (color pixels)R, G, and B is forwarded to the clear pixel AFE 18 through thehorizontal scanning circuit 13.

In the AFEs 17 and 18, the read signal is processed into analog formsuch as amplification, and converted to a digital signal, and thenforwarded to a signal processing part in the subsequent stage.

FIG. 14 shows a block diagram depicting an exemplary configuration of asubsequent signal processing part according to the embodiment.

As shown in FIG. 14, a signal processing part 20 has a white balanceadjusting part 21, a color pixel interpolating part 22, a brightnessadjusting part 23, and a clear pixel interpolating part 24.

The white balance adjusting part 21 adjusts white balance based on thesignals of the clear pixel C and the color filter pixels (color pixels)R, G, and B forwarded from the AFEs 17 and 18.

FIG. 15 shows a diagram illustrative of the white balance controlprocess at bright places in the embodiment.

FIG. 16 shows a diagram illustrative of the white balance controlprocess at dark places in the embodiment.

At bright places, the white balance adjusting part 21 adjusts thesignals of the clear pixel C and the other color filter pixels (colorpixels) R and B on the basis of the signal of the color filter pixel(color pixel) G.

On the other hand, at dark places, the white balance adjusting part 21adjusts the signals of the color filter pixels (color pixels) R, G, andB on the basis of the signal of the clear pixel C.

The interpolating part 22 performs the interpolation process only forthe color filter pixel (color pixel) part after white balance isadjusted.

The brightness adjusting part 23 adjusts the brightness signals of thecolor filter pixels (color pixels) R, G, and B and the brightness signalof the clear pixel C to output a brightness signal Y.

The interpolating part 24 performs the interpolation process for thewhite pixel based on the brightness signal to output a color signal SC.

As described above, the configuration and function of each part of theimaging device 10 according to the embodiment have been described.

Next, the structure of the pixel array part will be described.

FIG. 17 shows a diagram simply depicting a partial cross section of thepixel array part according to the embodiment.

In FIG. 17, 30 denotes a semiconductor substrate, 31 denotes deviceseparation areas, and 40 to 42 denote microlenses.

On the semiconductor substrate 30, N-sensor areas 32 and 33 of the colorfilter pixel (color pixel) and an N-sensor area 34 of the clear pixelare formed between the device separation areas 31.

In addition, 35 to 37 denote a P+ layer, and 38 denotes a P− layer.

In the embodiment, N− ions are implanted deep only in the N-sensor area34 of the clear pixel into the N-sensor areas 32 and 33 of the colorfilter pixel (color pixel) to increase the sensitivity on the highwavelength side. For example, it is configured to sense the wavelengtharea of near infrared rays.

FIG. 18 shows a diagram simply depicting a partial cross section ofanother exemplary configuration of the pixel array part according to theembodiment.

The pixel array part shown in FIG. 18 is configured in which theposition of the microlens 41 of the clear pixel C is varied from theheight position of the other color filter pixels (color pixels) foradjustment.

Accordingly, the beam condensing rate can be increased.

As described above, according to the embodiment, the pixel array part 11adopts the oblique pixel array, and is formed in a pixel arrangement inwhich the clear pixel C that has a high transmittance is uniformlyinserted in the vertical and oblique directions between a color filterpixel R having the peak of the spectral sensitivity characteristics inred, the color filter pixel G having the peak in green, and the colorfilter pixel B having the peak in blue, each including a color filter,whereby the deviation of the resolution is removed. It is configured inwhich the read channel CH-A exclusive for clear pixels and the readchannel CH-B exclusive for color filter pixels are provided separately,and the clear pixel C and the color filter pixels R, G, and B are readseparately. In addition to adopting the scheme to read the clear pixel Cand the color filter pixels (color pixels) R, G, and B by the differentchannels, and the time period, rate, and gain in processing in thesubsequent stage of the electronic shutter (rolling shutter) are changedseparately for the clear pixel C and the color filter pixels (colorpixels) R, G, and B. Therefore, the following advantage can be obtained.

For example, the pixel is rotated at an angle of 45 degrees to make thepixel pitch to 1/√2, and to increase the resolution. The area can bedoubled as compared with the case in which a typical pixel array has thesame pitch, sensitivity can be increased, and a clear (transparent)pixel is inserted into the color coating of the oblique pixel array tofurther improve the sensitivity.

In addition, when the clear pixel is arranged in the middle of the Bayerarray, the color interpolation process is facilitated.

In addition, the shutter time and gain can be changed separately betweenthe clear pixel C and the color filter pixels (color pixels) R, B and G.Therefore, the output of the clear pixel is made moderate at a brightplace, whereas the output is increased at a dark place, whereby a morenatural picture can be created as though a real one is seen by eyes.

As described above, the improved sensitivity is intended to enhance thesignal-to-noise ratio, and high speed read with low intensity can beimplemented due to the improved sensitivity.

In high speed read, for example, nine pixels are added to provide thesame arrangement after addition, whereby an advantage is exerted thatsignal processing in color production is facilitated.

In addition, in the discussion above, an example has been described inwhich the pixel array part 11 adopts the oblique pixel array as shown inFIG. 3, and is formed in the pixel arrangement in which the clear pixelC having a high transmittance is inserted between the color filter pixelR having the peak of the spectral sensitivity characteristics in red,the color filter pixel G having the peak in green, and the color filterpixel B having the peak in blue each including a color filter in thevertical and oblique directions, whereby the deviation of the resolutionis eliminated.

However, an embodiment of the invention is not limited to the pixelarrangement shown in FIG. 3, which can adopt various forms as a pixelarrangement into which the clear pixel is inserted, and can obtain thesame advantages as described above.

Hereinafter, anther exemplary configuration of the pixel arrangementwill be described.

FIG. 19 shows a diagram depicting a second exemplary pixel arrangementof the pixel array part according to the embodiment.

In the pixel arrangement of a pixel array part 11A shown in FIG. 19, aclear pixel C is arranged at the position at which the color filter(color pixel) G in the pixel arrangement shown in FIG. 3, and a colorfilter (color pixel) G is arranged at the position at which the clearpixel C shown in FIG. 3 is arranged.

In the pixel arrangement shown in FIG. 19, in the even numbered rowsincluding the zeroth row, the color filter pixel B and the clear pixel Care arranged alternately in a single pixel, in the even numbered columnsincluding the zeroth column, the color filter pixel R and the clearpixel C are arranged alternately in a single pixel, and the add numberedrow and the add numbered column are formed only of the color filterpixel G.

Also in the case of adopting the pixel array, the read channel CH-Aexclusive for clear pixels and the read channel CH-B exclusive for colorfilter pixels are provided separately, and the clear pixel C and thecolor filter pixel R, G, B are read separately. In addition to adoptingthe scheme to read the clear pixel C and the color filter pixels (colorpixels) R, G, and B by the different channels, it is configured in whichthe time period, rate, and gain in processing at the subsequent stage ofthe electronic shutter (rolling shutter) are changed separately for theclear pixel C and the color filter pixels (color pixels) R, G, and B.

However, the clear pixel C and the color filter pixel R or B are mixedin the same row, which causes the necessity of arranging a wiring forthe color filter pixel (color pixel) and a wiring for the clear pixel C.

FIG. 20 shows a diagram depicting an exemplary configuration in whichthe clear pixel and the color filter pixel are mixed in the same row.

In this case, as shown in FIG. 20, a shutter wiring and a clear pixelwiring for the color filter pixel (color pixel) are wired in a singlerow. More specifically, a color pixel reset wiring RSTL1 and a clearpixel reset wiring RSTL2 are wired.

The configuration of the unit pixel is the same as that in FIG. 2,omitting the detailed description.

FIG. 21 shows a diagram depicting a third exemplary pixel arrangement ofthe pixel array part according to the embodiment.

The pixel arrangement of a pixel array part 11B shown in FIG. 21 is anarrangement in which the clear pixel is included in all the rows andcolumns

In the pixel arrangement, the clear pixel is arranged at intervals, butalso in this case, the configuration similar to that in FIG. 20 isadopted, whereby the shutter can be released separately from theportions of the color pixel, and the clear pixel can be read separately.

FIG. 22 shows a diagram depicting a fourth exemplary pixel arrangementof the pixel array part according to the embodiment.

The pixel arrangement of a pixel array part 11C shown in FIG. 22 is anarrangement in which the clear pixel is included in each row and eachcolumn except the zeroth row and the zeroth column.

Also in the pixel arrangement, the clear pixel is arranged at intervals,but also in this case, the configuration similar to that in FIG. 20 isadopted, whereby the shutter can be released separately from theportions of the color pixel, and the clear pixel can be read separately.

FIG. 23 shows a diagram depicting a fifth exemplary pixel arrangement ofthe pixel array part according to the embodiment.

The pixel arrangement of a pixel array part 11D shown in FIG. 23 is anarrangement in which the position of arranging the color filter (colorpixel) G in the add numbered row of the pixel arrangement shown in FIG.3 is replaced by the color filter (color pixel) R.

In the pixel arrangement shown in FIG. 23, as similar to the array shownin FIG. 3, the add numbered row and the add numbered column areconfigured of only the clear pixel C.

In the pixel arrangement shown in FIG. 23, the pixel column of only thecolor filter (color pixel) G, the pixel column of the clear pixel C, thepixel column of the color filters (color pixels) R and B mixed are inturn arranged from the zeroth column, and the combination is repeated.

Also in the pixel arrangement, the shutter can be released separatelyfrom the portions of the color pixel, and the clear pixel can be readseparately.

FIG. 24 shows a diagram depicting a sixth exemplary pixel arrangement ofthe pixel array part according to the embodiment.

The pixel arrangement of a pixel array part 11E shown in FIG. 24 is anarrangement in which the clear pixel C is arranged at the position ofarranging the color filter (color pixel) G at the third, seventh,eleventh and fifteenth rows in the add numbered rows of the pixelarrangement shown in FIG. 3 to increase the clear pixel, intending thatthe sensitivity is more improved.

Also in the pixel arrangement, the shutter can be released separatelyfrom the portions of the color pixel, and the clear pixel can be readseparately.

FIG. 25 shows a diagram depicting a seventh exemplary pixel arrangementof the pixel array part according to the embodiment.

The pixel arrangement of a pixel array part 11F shown in FIG. 25 is anarrangement in which the color filter pixel (color pixel) G is removed,and in the even numbered rows and the even numbered columns includingthe zeroth row and the zeroth column, the pixel rows and the pixelcolumns are formed to have the color filter pixels (color pixels) R andB alternately arranged.

In this case, information about the color signal is formed based oninformation about the clear pixel and/or information about the colorfilters (color pixels) R and B having the spectral characteristics shownin FIG. 4.

Also in the pixel arrangement, the shutter can be released separatelyfrom the portions of the color pixel, and the clear pixel can be readseparately.

FIG. 26 shows a diagram depicting an eighth exemplary pixel arrangementof the pixel array part according to the embodiment.

The pixel arrangement of a pixel array part 11G shown in FIG. 26 is anarrangement in which the color filter pixel (color pixel) G is furtherremoved from the pixel arrangement shown in FIG. 25, the pixel rowincluding the clear pixel C is increased, and the pixel column includingthe clear pixel C is formed in every column.

In this case, information about the color signal is formed based oninformation about the clear pixel and/or information about the colorfilters (color pixels) R and B having the spectral characteristics shownin FIG. 4.

Also in the pixel arrangement, the shutter can be released separatelyfrom the portions of the color pixel, and the clear pixel can be readseparately.

FIG. 27 shows a diagram depicting a ninth exemplary pixel arrangement ofthe pixel array part according to the embodiment.

The pixel arrangement of a pixel array part 11H shown in FIG. 27 is anarrangement in which the color filter pixel (color pixel) G is furtherremoved from the pixel arrangement shown in FIG. 25, the pixel rowincluding the clear pixel C is increased, and the pixel column includingthe clear pixel C is formed in every column. In this case, the pixel rowincluding the color filter pixel (color pixel) is formed to have thepixel row including only the color filter pixel (color pixel) B and theclear pixel C and the pixel row including only the color filter pixel(color pixel) R and the clear pixel C.

In this case, information about the color signal is formed based oninformation about the clear pixel and/or information about the colorfilters (color pixels) R and B having the spectral characteristics shownin FIG. 4.

Also in the pixel arrangement, the shutter can be released separatelyfrom the portions of the color pixel, and the clear pixel can be readseparately.

As described above, exemplary configurations of the oblique pixel arrayhas been described. In the pixel arrangement, the characteristicconfiguration, in which the shutter can be released separately from theportions of the color pixel and the clear pixel can be read separately,can be adapted not only to the oblique pixel array but also to the pixelarrangements of the rectangular array as shown in FIGS. 28 to 36, forexample, and the same advantages can be obtained as those in the obliquearray.

FIG. 28 shows an example in which the oblique pixel array shown in FIG.4 is turned to the rectangular array, FIG. 29 shows an example in whichthe oblique pixel array shown in FIG. 19 is turned to the rectangulararray, FIG. 30 shows an example in which the oblique pixel array shownin FIG. 21 is turned to the rectangular array, FIG. 31 shows an examplein which the oblique pixel array shown in FIG. 22 is turned to therectangular array, FIG. 32 shows an example in which the oblique pixelarray shown in FIG. 23 is turned to the rectangular array, FIG. 33 showsan example in which the oblique pixel array shown in FIG. 24 is turnedto the rectangular array, FIG. 34 shows an example in which the obliquepixel array shown in FIG. 25 is turned to the rectangular array, FIG. 35shows an example in which the oblique pixel array shown in FIG. 26 isturned to the rectangular array, and FIG. 36 shows an example in whichthe oblique pixel array shown in FIG. 27 is turned to the rectangulararray.

In addition, the rectangular array, as shown in FIG. 37, as similar toFIG. 20, the shutter wiring and the clear pixel wiring for the colorfilter pixel (color pixel) are wired to a single row, more specifically,a color pixel reset wiring RSTL1 and a clear pixel reset wiring RSTL2are wired.

The configuration of the unit pixel is the same as that in FIG. 2,omitting the detailed description.

Furthermore, as shown in FIG. 38, in the rectangular array (or theoblique array), it may be configured in which the shutter wiring isprovided for every color filter pixel and every clear pixel.

In this case, a color pixel reset wirings RSTL1 and RSTL3 and a clearpixel reset wiring RSTL2 are wired.

The configuration of the unit pixel is the same as that in FIG. 2,omitting the detailed description.

FIG. 39 shows a block diagram depicting the outline of the configurationof a camera system according to an embodiment of the invention.

A camera system 50 is configured to have an imaging device 51, anoptical system which leads incident light into the pixel area of theimaging device 51, for example, a lens 52 which forms incident light(image) onto the imaging area, a drive circuit 53 which drives theimaging device 51, and a signal processing circuit 54 which processesthe output signal of the imaging device 51.

In the camera system 50, as the imaging device 51, the imaging deviceaccording to the embodiment is sued.

The drive circuit 53 is a circuit also corresponding to the timingcontrol part shown in FIG. 1, which drives the imaging device 51.

The signal processing circuit 54 applies various signal processes to theoutput signal Vout of the imaging device 51, and outputs it as a videosignal.

As described above, according to the camera system, the imaging deviceaccording to the embodiment is used as the imaging device 51, wherebyhigh speed operation can be secured. Therefore, a high quality imagewith less noise can be obtained in a small circuit scale at low powerconsumption.

In addition, the imaging device according to an embodiment of theinvention may be a single chip imaging device, or may be a moduleimaging device which is formed as an assembly of a plurality of chips.When it is an imaging device formed as an assembly of a plurality ofchips, chips are fabricated separately such as a sensor chip, and asignal processing chip for digital signal processing, and it may befurther include an optical system.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

What is claimed is:
 1. An imaging device comprising a pixel array on asubstrate in which a plurality of pixels are arranged in an array, thepixels configured to convert light into electric signals, said pixelscomprising a plurality of color filter pixels and at least one clearpixel, wherein: the plurality of color filter pixels include at leasttwo of (i) a first color filter pixel with a first filter effective tocause the first color filter pixel to have a peak spectral sensitivityfor red light, (ii) a second color filter pixel with a second filtereffective to cause the second color filter pixel to have a peak spectralsensitivity for blue light, and (iii) a third color filter pixel with athird filter effective to cause the third color filter pixel to have apeak spectral sensitivity for green light; the at least one clear pixelhas no filter or a fourth filter with a high transmittance such that theclear pixel is sensitive to white light; at least a portion of theplurality of color filter pixels is arranged in an array; the at leastone clear pixel is arranged in the array at a given position of a givenrow and a given column with respect to the at least two of the firstcolor filter pixel, the second color filter pixel, and the third colorfilter pixel; and a first read channel is exclusively coupled to the atleast one clear pixel and a second read channel is exclusively coupledto the plurality of color filter pixels.
 2. The imaging system of claim1, wherein the first read channel and the second read channel are atopposite sides of the array.
 3. The imaging system of claim 1, whereinthe at least one clear pixel is in the middle of a sub-array with aBayer arrangement and the electric signals of eight color filter pixelsof the sub-array and the at least one clear pixel are added together andthe result is read out via the first read channel.
 4. The imaging systemof claim 1, wherein for each of one of the color filter pixels, the oneof that color filter pixel is in the middle of a rectangular sub-arrayof pixels and the electric signals of nine color pixels in the sub-arrayof the same color as the one of the color filter pixels are addedtogether and the result is read out via the second read channel.
 5. Theimaging system of claim 1, wherein the at least one clear pixel is inthe middle of a sub-array with a Bayer arrangement and the electricsignals of the at least one clear pixel and four other clear pixels inthe sub-array are added together and then read out via the firstchannel.
 6. The imaging system of claim 1, wherein for each of one ofthe color filter pixels, the one of that color filter pixel is in themiddle of a rectangular sub-array of pixels and the electric signals offive color pixels in the sub-array of the same color as the one of thecolor filter pixels are added together and the result is read out viathe second read channel.
 7. The imaging system of claim 1, wherein thepixel array is rectangular and contains only first and second colorfilter pixels and clear pixels, and the pixels are arranged such thatthe clear pixels are present only in odd diagonal lines and the firstand second color filter pixels are present only in even diagonal lines.8. The imaging system of claim 1, wherein the pixel array is rectangularand contains only first and second color filter pixels and clear pixels,and the pixels are arranged such that the clear pixels are present onlyin two adjacent diagonal lines and the first and second color filterpixels are present only in every third diagonal line.
 9. The imagingsystem of claim 1, wherein the pixel array is rectangular and containsonly the first and second color filter pixels and clear pixels, and thepixels are arranged such that every other column is comprised only ofclear pixels and, in the remaining columns, the pixels alternate betweenthe first color filter and the second color filter pixels and a clearpixel.
 10. A camera system comprising an imaging device with a pixelarray on a substrate in which a plurality of pixels are arranged in anarray and the pixels convert light into an electric signal, said pixelscomprising a plurality of color filter pixels and at least one clearpixel, wherein: the plurality of color filter pixels include at leasttwo of (i) a first color filter pixel with a first filter effective tocause the first color filter pixel to have a peak spectral sensitivityfor red light, (ii) a second color filter pixel with a second filtereffective to cause the second color filter pixel to have a peak spectralsensitivity for blue light, and (iii) a third color filter pixel with athird filter effective to cause the third color filter pixel to have apeak spectral sensitivity for green light, the at least one clear pixelhas no filter or a fourth filter with a high transmittance such that theclear pixel is sensitive to white light; at least a portion of theplurality of color filter pixels is arranged in an array; the at leastone clear pixel is arranged in the array at a given position of a givenrow and a given column with respect to the first color filter pixel, thesecond color filter pixel, and the third color filter pixel; and a firstread channel is exclusively coupled to the at least one clear pixel anda second read channel is exclusively coupled to the plurality of colorfilter pixels.
 11. The camera system of claim 10, wherein the first readchannel and the second read channel are at opposite sides of the array.12. The camera system of claim 10, wherein the at least one clear pixelis in the middle of a sub-array with a Bayer arrangement and theelectric signals of eight color filter pixels of the sub-array and theat least one clear pixel are added together and the result is read outvia the first read channel.
 13. The camera system of claim 10, whereinfor each of one of the color filter pixels, the one of that color filterpixel is in the middle of a rectangular sub-array of pixels and theelectric signals of nine color pixels in the sub-array of the same coloras the one of the color filter pixels are added together and the resultis read out via the second read channel.
 14. The camera system of claim10, wherein the at least one clear pixel is in the middle of a sub-arraywith a Bayer arrangement and the electric signals of the at least oneclear pixel and four other clear pixels in the sub-array are addedtogether and then read out via the first channel.
 15. The camera systemof claim 10, wherein for each of one of the color filter pixels, the oneof that color filter pixel is in the middle of a rectangular sub-arrayof pixels and the electric signals of five color pixels in the sub-arrayof the same color as the one of the color filter pixels are addedtogether and the result is read out via the second read channel.
 16. Thecamera system of claim 10, wherein the pixel array is rectangular andcontains only first and second color filter pixels and clear pixels, andthe pixels are arranged such that the clear pixels are present only inodd diagonal lines and the first and second color filter pixels arepresent only in even diagonal lines.
 17. The camera system of claim 10,wherein the pixel array is rectangular and contains only first andsecond color filter pixels and clear pixels, and the pixels are arrangedsuch that the clear pixels are present only in two adjacent diagonallines and the first and second color filter pixels are present only inevery third diagonal line.
 18. The camera system of claim 10, whereinthe pixel array is rectangular and contains only the first and secondcolor filter pixels and clear pixels, and the pixels are arranged suchthat every other column is comprised only of clear pixels and, in theremaining columns, the pixels alternate between the first color filterand the second color filter pixels and a clear pixel.
 19. A method fordriving a camera system comprising: providing a camera system having animaging device with a pixel array on a substrate in which a plurality ofpixels are arranged in an array and the pixels convert light into anelectric signal, said pixels comprising a plurality of color filterpixels and at least one clear pixel, the plurality of color filterpixels including at least two of (i) a first color filter pixel with afirst filter effective to cause the first color filter pixel to have apeak spectral sensitivity for red light, (ii) a second color filterpixel with a second filter effective to cause the second color filterpixel to have a peak spectral sensitivity for blue light, and (iii) athird color filter pixel with a third filter effective to cause thethird color filter pixel to have a peak spectral sensitivity for greenlight; separately performing electronic shutter drives for the at leastone clear pixel and for the plurality of color filter pixels; andseparately changing, for the at least one clear pixel and for theplurality of color filter pixels, at least one of time period, rate andgain in processing, wherein, the at least one clear pixel has no filteror a fourth filter with a high transmittance such that the clear pixelis sensitive to white light; at least a portion of the plurality ofcolor filter pixels is arranged in an array; the at least one clearpixel is arranged in the array at a given position of a given row and agiven column with respect to the first color filter pixel, the secondcolor filter pixel, and the third color filter pixel; and a first readchannel is exclusively coupled to the at least one clear pixel and asecond read channel is exclusively coupled to the plurality of colorfilter pixels.
 20. The method of claim 19, comprising at bright places,adjusting the white balance of the signals of the clear pixel the colorfilter pixels based on the signal of a green color filter pixel.
 21. Themethod of claim 19, comprising at dark places, adjusting the whitebalance of the signals of the clear pixel the color filter pixels basedon the signal of the clear pixel.
 22. The method of claim 20, comprisingperforming an interpolation process only for the color filter pixelsafter white balance is adjusted.
 23. The method of claim 21, comprisingperforming an interpolation process only for the color filter pixelsafter white balance is adjusted.